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© Computer graphics display method and system with shadow generation. 

© A computer graphics display system and method are described for rendering a scene formed of at least ^ one 
geometric primitiv e as a pixel image having shadows produced by at least one ^J*"™?"^ 
passes are made through the primitive data structure for each light source capable of produang shadowsm ^the 
scene to be rendered. In a first pass, the scene is rendered to a frame buffer m the usual way. but us ng only 
the ambient component of the light specification, and a first Z-buffer is updated with the v.ewpo.nt Z value. For 
each defined ligM source <i). two additional passes (PASS 2i and 2i ♦ 1) through the data «^ " 
m the first of these, a transformation matrix is set up in such a way that the viewpoint « moved to the P**™ * 
the light source. The scene is then rendered in the usual way except that the frame buffer « not updated > and la 
second Z-buffer (light source view Z-buffer) is used instead of the first Z-buffer In the next pass the shaded 
image and shadows are generated in parallel using the content of the first and second Z-buff ers When the 
frame buffer is updated, it is accomplished in a cumulative manner with each computed ' ntens '2 n ^ e m d e U !^°^ 
specific light source being added to any value already stored there. In this way. .ntens.fes resultant from each of 
multiple light sources are accumulated on the image. 
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Technical Field 

The present invention relates generally to computer graphics generation and display, and more 
particularly, to a method and system for rendering a scene formed of at least one geometric primitive as a 
s pixel image having a shadow(s) cast by another geometric primitive which is blocking the illumination of one 
or more defined light source(s). 

Background Art 



10 The quality of computer graphics display system images and the time required to process these 
images have been steadily improving with each new generation of graphics display equipment Continued 
improvement is clearly beneficial since images which approach photographic quality and project a real- 
world paradigm are much easier to interpret while high speed processing allows more productive user 
interaction with displayed images. For example, currently available graphics display systems are able to 

75 provide highly interactive images with shading of displayed objects. Screen shading accurately models the 
surface effects of different types of lighting sources on displayed objects and the shading effects provide 
visible cues as to the shape and contours of the objects. Much of the processing required to produce 
shading effects is done in hardware which interpolates colors between polygon vertices, e.g., using a well 
known technique such as Gouraud Shading. 

20 Other visual cues such as surface textures, motion blur, object reflections and shadows can also be 
added to an image to further improve its quality. However, these enhancements traditionally require 
extensive software processing cycles, which make the graphics system less user interactive. The present 
invention specifically addresses improving the processing time for one of these enhancements, namely, 
generating shadows cast when objects block the illumination of one or more defined light sources in a 

25 scene to be rendered. 

Typical computer graphics systems are capable of determining the surface color of an object at a given 
pixel and whether a pixel is visible from a defined viewpoint, and therefore whether the pixel belongs in the 
associated frame buffer. To accomplish this it is necessary to perform an interpolation of R.G.B and Z in 
X,Y space (six-axis interpolation). Since any information as to the positional relationship between light 

30 sources and objects is discarded by the geometry processing engine of the graphics system after the 
lighting calculation step, it is impossible for the subsequent raster processing sub-system to determine if an 
object casts a shadow on another object to appear in the pixel image. 

As described by P. Bergeron in an IEEE September, 1986 publication entitled "A General Version of 
Crow's Shadow Volumes" (pp. 17-28), there are presently five known classes of shadow generation 

35 algorithms. Namely: 

(1) Shadow computation during display (A. Appel, "Some Techniques for Shading Machine Renderings 
of Solids," Proc. Spring Joint Computer Conference, Thompson Books, Washington, DC. pp. 37-45, 
1968); 

(2) Polygon shadow generation based on clipping transformation (Atherton and Weiler, "Polygon Shadow 
40 Generation," Computer Graphics, (Proc. SIGGRAPH 78) Vol. 12, No. 3, pp. 275-281, July 1978; 

(3) Shadow volumes (F. Crow, "Shadow Algorithms for Computer Graphics," Computer Graphics, (Proc. 
SIGGRAPH 77) Vol. 11. No. 3, pp. 242-248, July 1977; 

(4) Z-buffer shadow computation (L Williams, "Casting Curved Shadows on Curved Surfaces," Computer 
Graphics, (Proc. SIGGRAPH 78), Vol. 12, No. 3, pp. 270-274, July 1978; and 

45 (5) Ray tracing (see Whitted, * An Improved Illumination Model for Shaded Display," Comm. ACM, Vol. 
23. No. 6, pp. 343-349, June 1980). 
Of the above techniques, only the Z-buffer algorithm approach described by L. Williams operates in image 
space and allows a scene of any complexity to be handled. Briefly described, the Williams shadow 
generation method utilizes two passes through a Z- buffer algorithm, one for a viewer and one for a light 

so source. Determination of whether a surface is to be shadowed is made by using image-precision 
calculations. 

The Williams algorithm begins by calculating and storing just the Z-buffer values for an image from the 
perspective of the light source, wherein increasing values represent increasing distance. Next, the Z-buffer 
and the image are calculated from the viewpoint of an observer using a Z-buffer algorithm with the following 
55 modification. Whenever a pixel is determined to be visible, its object-precision coordinates in the observer's 
view (Xo.Yo.Zo) are each computationally transformed into coordinates in the light source's view 
(X'oTo.Z'o). The transformed coordinates Xo and Y* 0 are used to select a value Z t in the light source's Z- 
buffer to be compared with the transformed value ZV If Z L is closer to the light source than is Z*c then 
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there is something blocking the light from that point, and the pixel ,s shaded as tang « f^*£"S; 
the point is visible from the light and it is shaded as being lighted. Th,s computationally .ntens.v . approach 
requires extensive transformation calculations between the light source and viewpoint view coordinates for 
each p ; ixel Because of these computations, user interactiveness with the computer graph.cs system ,s less 
s than optimal, and degrades significantly with the addition of a second or more light source. 

Thus a need continues to exist in the computer graphics processing art for a new shadow generat.cn 
technique which solves the shadow generation problem in image space and improves upon the perfor- 
mance of previous shadowing approaches. 

10 Discl osure of Invention 

Briefly described, this invention provides a computer graphics display method and system for rendering 
a scene formed of at least one geometric primitive as a pixel image with shadow(s) resulting from other 
object blocking illumination from one or more defined light sources. The graphics display system includes a 
,5 first Z-buffer a second Z-buffer and a frame buffer, each of which has storage locations corresponding to 
the pixels which are to form the image. The image has a defined viewpoint and at least one light source 
such that each primitive is represented by one or more pixels (X.Y) relative to the def.ned viewpoint and 
one or more pixels (Xs.Ys) relative to the defined light source. In one embodiment, the .mage rendering 
method includes the steps of: for each pixel (X,Y). generating a first depth value (Z) representative of the 
20 depth from the defined viewpoint to that pixel and saving the first depth value in the corresponding pixel 
location of the first Z-buffer if the first depth value (Z) is visible to the defined viewpoint .n comparison with 
the depth value stored in the corresponding pixel location of the first Z-buffer; for each pixel (Xs.Ys^ 
generating a second depth value (Zs) representative of the depth of the pixel to the defined light source and 
saving the second depth value (Zs) in the corresponding pixel location of the second Z-buffer if the second 
25 depth value (Zs) is visible to the light source in comparison with a depth value stored in the corresponding 
pixel location of the second Z-buffer; and for each pixel forming the pixel image, generating using only the 
defined light source, a representative color value (Rs.Gs.Bs) and adding to a corresponding (X.Y) Pixel 
location of the frame buffer the representative color value (Rs.Gs.Bs) for the pixel if the corresponding depth 
value in the first Z-buffer identifies a pixel visible to the viewpoint and if the corresponding depth value in 
so the second Z-buffer identifies a pixel visible to the light source. Further specific method details and 

enhancements are also described and claimed. ' 

In another aspect, the invention provides a computer graphics display system with shadow generation 
capability for rendering a scene formed of at least one geometric primitive as a pixel image. The scene to 
be rendered includes a defined ambient lighting value, viewpoint and light source such that each primitive 
35 has one or more pixel (X.Y) associated therewith in a first, viewpoint coordinate space. 

pixel (Xs.Ys) associated therewith in a second, light source coordinate space. The graphics display system 
includes a geometry processing engine for converting the at least one geometric primitive into device XXZ 
coordinates relative to the viewpoint and device Xs.Ys.Zs coordinates relative to the ght source. A frame 
buffer first Z-buffer and second Z-buffer are also provided, each of which has storage locations correspond- 
40 ing to the pixels forming the image of the rendered scene. A raster processing engine is coupled to receive 
the output of the geometry processing engine, and is also coupled to the frame buffer, first Z-buffer and 
second Z-buffer for controlling the storage of values thereto. The raster processing engine includes: first 
storage means which directs the storage of pixel depth values in the first Z-buffer whenever a determined 
pixel depth value (Z) is equal or closer to the viewpoint than a depth value already stored ,n the 
« corresponding pixel location of the first Z-buffer; second storage means which directs the storage of second 
pixel depth values (Zs) in the second Z-buffer whenever a determined depth value (Zs) is equal or closer to 
the light source than a depth value already stored in the corresponding pixel location of the second z- 
buffer generating means for producing a representative color value (Rs.Gs.Bs) for each pixel forming the 
image using only the defined lighting source; and accumulating means for adding to the corresponding 
so (X Y) pixel location of the frame buffer the generated representative color value (Rs.Gs.Bs) for the pixel if 
the corresponding depth value in the first Z-buffer identifies a pixel visible to the viewpoint and the 
corresponding depth value in the second Z-buffer identifies a pixel visible to the light source. 

To summarize, the present invention comprises a shadow generation approach which advantageously 
enhances processing times in comparison with known shadow rendering techniques, so. that user .nterac- 
55 tiveness with the graphics system is optimized. 
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Brief Description of Drawings 

These and other objects, advantages and features of the present invention will be more readily 
understood from the following detailed description of certain preferred embodiments of the present 
5 invention, when considered in conjunction with the accompanying drawings in which: 

FIG. 1 is a general block diagram representation of an interactive computer graphics display system of 
the present invention; 

FIG. 2 is a block diagram representation of a conventional computer graphics display system; 
FIG. 3 is a block diagram representation of a computer graphics display system pursuant to the present 
io invention; 

FIG.S 4A, 4B, 4C1 & 4C2 comprise a flowchart representation of one embodiment of pixel image 
processing pursuant to the computer graphics display system of FIG. 3; and 

FIG. 5 graphically illustrates a potential problem arising with use of the computer graphics display 
system of FIG. 3, which is addressed by the pixel image processing method of FIG.S 4A-4C2. 

75 

Best Mode For Carrying Out The Invention 



Reference is now made to the drawings in which the same reference numbers are used throughout the 
different figures to designate the same or similar components. 

20 In FIG. 1, a general block diagram representation of the interaction-between a graphics system 10 and a 
host computer 12 is shown. Computer 12 includes an application program 14 and an application data 
structure 16. Application program 14 stores into and retrieves data from application data structure 16 and 
sends graphics commands to graphics system 10. Data structure 16 holds descriptions of real or abstract 
figures or objects which are to appear on a graphics monitor (not shown) associated with system 10. An 

25 object description stored within data structure 16 comprises geometric coordinate data which defines the 
shape of components of the object, object attributes, and connectivity relationships and positioning data that 
define how the components fit together. For example, objects are commonly defined by geometric 
primitives or polygons, such as quadrilaterals or triangles. 

Graphics system 10 includes a geometry processing engine 18 and a raster processing engine 20 

30 coupled thereto. Engines 18 & 20 comprise separate sub- systems, each of which typically includes 
multiple pipelined or parallel connected processors. Engine 18 conventionally implements floating point 
geometry processing to convert information from modeling or world coordinates and colors to screen 
coordinates and colors through several well known processing steps, including tessellation, lighting calcula- 
tion, clipping, transformation, mapping, etc. Certain of these processing steps are discussed further below 

35 as they relate to the present invention. Raster processing engine 20 traditionally implements a scan 
conversion operation wherein individual pixels are integer processed (e.g., through an edge processor and a 
span processor coupled thereto) for ultimate screen display. 

To facilitate a description of the unique structure/function of a shadow generation unit in accordance 
with the present invention, the operation of a typical shaded solid rendering system (which includes a 

40 geometry processing engine 18 and a raster processing engine 20) is initially discussed with reference to 
the structural/functional blocks of FIG. 2. 

Information in an associated application data structure 16, including a 3D object database 30 and a light 
source database 32, is retrieved by geometry processing engine 18 of graphics system 10. Objects in a 
three-dimensional scene to be two-dimensional ly represented are typically composed of surface polygons 

45 or specified in a functional or parametric way such as B-spline surfaces. Information such as X,Y,Z vertices 
in world coordinates and normals to the provided surfaces are commonly included. Engine 18 tessellates 
the provided information and implements well known lighting equations (e.g., Gouraud shading) using 
retrieved, predefined ambient, diffuse and specular lighting components. 

During the lighting calculation process 34, the color and intensity at each vertex is determined by 

so lighting equations which consider object and ambient/light source color, direction of any light vector, surface 
and/or vertex normals, and the direction of the reflection vector if specular highlights are desired. Output in 
world coordinates from block 34 are polygon data vertices (X.Y.Z) and lighting intensity levels (R,G,B). This 
information is then clipped, projected and mapped at process block 36 to the desired viewport in screen 
coordinates. 

55 Input to raster processing engine 20 are the polygon vertices specified as integer X,Y,Z coordinates in 

screen space, and the R,G,B components of intensity. This information is fed to edge processing 38 which 
decomposes each triangle, for example, into a series of horizontal spans by interpolating the X.Z.R.G and B 
values with respect to Y between the vertices. Each span on a given scan line (Y value) consists of X(i) and 
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X(r) (i.e., the horizontal left (I) and horizontal right (r) limits of the span). R.G.B and I Z at the left edge and 
the partial derivatives of R.G.B and Z with respect to X (dR/dX. dG/dX. dB/dX. dZ/dX) as determmed from 
the plane equation. The Y address (Y-ADDR) is made directly available to a frame buffer 42 and a Z-buffer 
44 via line 39. A span processing operation 40 decomposes each horizontal span into .nd.vidual pocels (and 
considers storing of intensity values to frame buffer 42) according to the following process: 



10 



15 



R(X(1),Y) = R(l) 

G(X(1),Y) = G(l) 

BXl.Y = B(l) 

Z(X(1),Y) = Z<1) 

For X = X(l)+1 to X(r) 



(X,Y) = R(X-1,Y> + 

(X,Y) = G<X-1,Y> + 

(X,Y) = B(X-1,Y) + dB/dX 

(X,Y> = Z(X-1,Y) + dZ/dX 



dR/dX 
dG/dX 



20 



If ( Z(X,Y) > Z-BUFFER(X,Y) ) 

ThCn Update R(X,Y), G(X,Y), B(X,Y), Z-BUFFER(X,Y) . 



The derived X address (X-ADDR) is made available to both frame buffer 42 and Z-buff er 44 while the 
derived intensity values (R.G.B) are available only to buffer 42 and the computed Z depth value (Z VALUE) 

25 only to Z- buffer 44. . . 

Frame buffer 42 and Z-buffer 44, which can be accessed in parallel, each have a single entry for each 
(XY) pixel address. The comparison (Z(X.Y) > Z-BUFFER (X.Y)) ensures that only the pixels .n a triangle 
that are closest to a viewer are written to frame buffer 42 after the entire scene has been processed 
Typically one pass through the data structure is sufficient to render a scene with light source shading o 

30 objects and hidden surface removal. Also, the order of processing is generally irrelevant, so no sorting of 
data is required. The calculation of R.G.B and Z as a function of X and Y, is referred to in the art as 6-ax.s 
interpolation, since each vertex represents a point in 6-space. Buffer 42 is used to refresh a display monitor 
(not shown) via line 45. 

Of the known classes of shadow generation algorithms (see Background section), most if not all, are 

35 implemented in the geometry processing phase of the graphics system. For example, see ; the , Z-buffer 
shadow computation approach described by I. Williams in the above-referenced article, entitled Casting 
Curved Shadows on Curved Surfaces." Such an approach, however, is similar to having dual p.pel.nes and 
managing them simultaneously. Obviously, with the addition of multiple light sources the image-precision 
calculations of the Williams approach quickly become too complex. 

40 In contrast to most previous shadowing approaches, the present inventive shadowing technique is 
implemented within the raster processing sub-system of the graphics unit. The approach ,s '^lio^y 
similar in several ways to that described above with respect to FIG. 2. however, a second Z-buffer is added 
to track pixel depth of geometric primitives relative to one or more discrete light sources applied to the 
scene to be represented. Multiple passes are made through the data structure for each light source capable 

,s of producing shadows in the scene. An overview of this technique is next discussed with reference to FIG. 
3 which depicts a modified structural/functional graphics system pursuant to the present invention. 

As shown, information from an associated application data structure 116 (including a 3D object database 
130 and a light source database 132) of a host computer 112 is initially fed to a geometry processing 
engine 118 of graphics system 100. System 100 also includes a raster processing engine 120 coupled to 

so engine 118. Operationally engine 1 18 begins processing by tessellating and applying lighting equations 134 
to the retrieved data. In addition to forwarding, for example, polygon data vertices X.Y.Z in world 
coordinates and color intensities R.G.B to the clip, project and map function 136 of engine 118. function 
block 134 also generates polygon data vertices Xs.Ys.Zs in world coordinates. Vertices Xs.Ys.Zs represent 
the retrieved data vertices defined in relation to the light source(s) applied to the scene to be rendered, i.e., 

55 polygon data vertices Xs.Ys.Zs are generated in each of one or more light source view coord.nates Xs.Ys.Zs 
(wherein s=1....N light sources). 

A second Z-buffer 144 is provided pursuant to the present invention for accommodating Zs values 
representative of the pixel depth from the point of view of a predefined light source rathe, ihan i,om a 
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viewer. The pixel addresses to the second Z-buffer (i.e., the light source view buffer) are designated Xs,Ys 
and are not the same X.Y pixel addresses which access a frame-buffer 142 and a first Z-buffer 143 (i.e., 
viewpoint Z-buffer). 

As described further below, the shadow generation algorithm set forth herein operates by taking 

5 multiple passes over the data, depending upon the number of light sources in the scene. In a first pass, the 
scene is rendered to the frame-buffer in the usual way, updating the first Z-buffer with the viewpoint Z- 
value,. but using only the ambient component of the light specification to determine the corresponding color 
values R,G,B to be stored. Other than using only ambient light in the lighting calculation, first pass 
processing is essentially as described above with reference to FIG. 2. 

io Input to raster processing engine 120 are the polygon vertices specified as integer X,Y,Z coordinates 
and Xs.Ys.Zs coordinates in screen space, and the R,G,B components of intensity due to the defined 
lighting. This information is fed to polygon edge processing 138 which decomposes each triangle, for 
example, into a series of horizontal spans by interpolating the X,Z ( Xs,Ys,Zs,R,G & B values with respect to 
Y between the vertices. Each span on a given scan line (Y value) consists of X(l) and X(r) (i.e.. the horizontal 

75 left (I) and horizontal right (r) limits of the span), R,G,B,X,Z,Xs,Ys & Zs at the left edge and the partial 
derivatives of Z,R,G,B,Xs,Ys & Zs with respect to X as determined from the plane equation. The Y address 
(Y- ADDR) is made directly available to frame buffer 142 and first Z-buffer 143 via line 139. A span 
processing operation 140 subsequently decomposes each horizontal span into individual pixels as de- 
scribed further below. Buffer 142 is used to refresh a display monitor (not shown) via line 145. 

20 After completing the first pass, the frame-buffer contains the scene-as it would appear if no specific light 
sources, besides ambient lighting, were identified. The resultant screen image appears dim. The first Z- 
buffer (viewpoint Z-buffer) contains the Z values for the pixels which represent the closest points to the 
viewer in viewpoint coordinate space. 

For each defined light source, two additional processing passes through the data structure are required. 

25 In the first of these, a transformation matrix is set up in such a way that the viewpoint is moved to the 
position of a light source. The scene is then rendered in the usual way except that- the frame-buffer is not 
updated, and the second, light source view Z-buffer is used instead of the first, viewpoint view Z-buffer. 



Span processing in engine 120 is represented as : 

Z(X(1),Y) = Z(l> 

For X = X(l)+1 to X(r) 

Z(X,Y> = Z(X-1,Y> + dZ/dX 

If ( Z(X,Y) > SECOND_ZBUFFER(X,Y) ) 

Then 

Update SEC0ND_23UFFER(X,Y) 



In the next pass, the shaded image and shadows are generated in parallel. The transform clip/map 
40 process 136 generates vertex data relative to both the light source and the viewpoint, and the lighting 
calculations generate the intensity based on the diffuse and the specular components of the subject light 
source with no ambient lighting considered- Input to edge processing then consists of triangles with 9- 
valued vertices, and interpolation proceeds in 9-space. In particular, each vertex consists of: 
X - screen space X coordinate (from viewpoint) 
45 Y screen space Y coordinate (from viewpoint) 

Z - screen space Z coordinate (from viewpoint) 
R - red component of intensity for light 
G - green component of intensity for light 
B - blue component of intensity for light 
so Xs - screen space X coordinate (from light source) 
Ys - screen space Y coordinate (from light source) 
Zs - screen space Z coordinate (from light source) 
Edge processing is similar to that described above with respect to FIG. 2, with the addition of edge and 
derivative calculations for Xs.Ys.Zs (i.e.. dXs/dX,dYs/dX,dZs/dX). As noted, a span now consist of X(D and X- 
55 (r). the left edge values of R,G,B.Z T Xs.Ys.Zs and the partial derivatives of R,G t B,Z,Xs.Ys and Zs with respect 
to X. These can all be generated from the plane equations in X and Y. 

Span processing proceeds by interpolating R,G.B.Z,Xs.Ys,Zs between X(l) and X(r), using bom the first 
and second Z-buffers 143 & 144, respectively, to decide whether to update the frame buffer 142 Since 
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„cond Z*u1fer <UaHt source »ew Z*uffer> tundra** £2.^JLn »» wme butter is updated. II is 

span processing on the third, pass is: 
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Ys(X(l),Y = Ysjl 
Zs(X(l),Y) - Zs(l) 

For X = X(l)+1 to X(r) 

R(X,Y) = R(X-1,Y) + dR/dX 
G X Y = G(X-1.Y + dG/dX 

Z X Y = Z X-l.Y) + dZ/dX 

Xs(X,Y) = Xs(X-l,Y + dXs/dX 

Ys(X,Y) = Ys(X-l,Y + dYs/dX 

Zs(x!y) - Zs(X-l.Y) + dZs/dX 

If ( Z<X,Y) >= FIRST_ZBUFFER(X.Y) ) and 
( Zs(X,Y) >= SECOND_ZBUFFER(Xs,Ys) ) 

^SframebufferJX.Y) = R(X,Y) + amebuffer(X.Y) 
Gframebuffer(X r Y) = G X,Y + Rframebuffer X,Y 
Bframebuffer X,Y) = B<X.Y$ + Rframebuffer<X,Y) 



A more specific exp.anation of the processing technique of the present invention is next described with 
reference to the functional flowcharts of TIG S 4 ^^\ & ^\ s ^ input information stored in data 

sr ails 

coordinates. In addition, viewing information .nclud.ng pos.fon of «™.™"™"™Ms clipping planes 
M orientation of viewing window in world coordinates, screen v.ewport .n *«j»oo«*-«. c PP 9 P 
defined in world coordinates and the type of pro,ectu>n (u> ^ogonri« JJ^ direction if 

list of N light sources and their attributes (color. f^^L^S,!^^ predefined. The 
infinite) are specified in wor.d coordinates. Typed y . an '^^^^^^o.m 
ambient light component simulates background light illum.nat.ng a surface totally 

" TZZrZl:^* Z-buffer and second Z-buffer are cleared. 20< ^^^^ 
Buffer, i Second Z-Buffer, and a viewpoint transfo, ^^^J^p^^ 
Transformation Matrix Mv.» Matnx Mv .s ^ to . ,rans ^ i Jr qiven window and viewport 
coordinates to device coordinates viewed from the v.ewpo.nt port or . usmg the g.ven ™™ * 
size and orientation. Thereafter, a light source transformation matnx M where. , ,-i JN»««M o 
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Using Matrix Mv." Typical geometric processing includes fetching the primitives from data memory, 
transforming vertices and control points to world coordinates (if necessary), tessellating primitives into 
planar polygons such as triangles (if necessary), performing a clipping test and (if necessary) clipping to a 
defined view volume. Each of these manipulations is well understood by those skilled in the art. Along with 

5 transforming triangle vertices to device coordinates using the matrix Mv, perspective division may be 
performed, again if required. After converting the vertices to device coordinates, edges are scan converted 
into a series of horizontal or vertical spans, 212 "Scan Convert Edges Into Series Of Horizontal Spans." 
This typically involves computation of Bresenham parameters or OOA slopes for scan converting of triangle 
edges and then scan converting the edges into end points of a series of horizontal (or alternatively vertical) 

io spans. 

Each X position in each horizontal span is next considered for computation and storage of Z values. 
This is accomplished by first selecting a horizontal span for processing, 214 "Select A (Next) Horizontal 
Span For Processing, " after which a pixel X position in the selected span is selected, 216 "Select A (Next) 
Pixel X Position In Selected Span." A depth value for the selected pixel is computed and compared to the 

75 corresponding contents of the first Z-buffer, 218 "Compute Z Value Of Selected Pixel And Compare To 
Corresponding Contents of First Z-Buffer." Logical inquiry is then conducted into whether the selected pixel 
is visible to the viewpoint, 220 "Is Selected Pixel Visible?" If "yes" (meaning that the calculated Z value is 
closer to the eyepoint than the corresponding value in the first Z-buffer), then the Z-buffer value is replaced 
with the just calculated pixel Z value and the frame buffer pixel value is replaced with the corresponding 

20 ambient color value, 222 "Update First Z-Buffer With Pixel Z Value & .Update Frame Buffer With Ambient 
Color Value." 

From instruction 222 processing passes through junction 224 to inquire whether all pixels in the subject 
span have been processed, 226 "All Pixels in Span Selected?" (Alternatively, if the selected pixel is not 
visible to the viewpoint, processing proceeds directly from inquiry 220 through junction 224 to inquiry 226.) 

25 While the answer to inquiry 226 remains "no," processing continues to loop back to instruction 216 for 
selection of a next pixel X position in the selected span. Once all pixels in a selected span have been 
processed, inquiry is made into whether all spans have been selected for processing, 228 "All Spans 
Selected?" If "no," processing returns to instruction 214 for selection of a next horizontal span. If "yes," 
then first pass processing (PASS 1) through the data structure is complete and processing proceeds to FIG. 

30 4B. 

FIG.S 4B, 4C1 & 4C2 together represent the two novel passes through the data structure pursuant to 
the present invention which are to be accomplished in combination for each defined light source (i.e., PASS 
2i and PASS 2i + 1, wherein i = 1...N, and N equals the number of light sources). 

Initially, a defined light source is selected, 230 "Select A (Next) Defined Light Source (i)," and the 

35 second Z-buffer is cleared, 232 "Clear Second Z- Buffer." Thereafter, for each primitive in the data 
structure the second pass (PASS 2i) includes performing geometry processing and transforming triangle 
vertices to device coordinates (i.e., light source view coordinates) using the corresponding matrix Mi, 234 
"For Each Primitive In The Scene, Perform Geometry Processing And Transform Triangle Vertices to 
Device Coordinates Using Matrix Mi." 

40 Again, geometry processing might include fetching a primitive from data memory, transforming vertices 
and control points to world coordinates (if necessary), tessellating primitives into planar polygons (if 
necessary), performing clip testing and clipping to a view volume Of necessary). Thereafter, edges are scan 
converted into a series of horizontal spans. 236 "Scan Convert Edges Into Series Of Horizontal Spans." 
Instruction 236 includes computing Bresenham parameters or DDA slopes for scan converting of the 

45 triangle edges and actual scan conversion of the triangle edges into end points of a series of horizontal (or 
alternatively vertical) spans. 

Depth buffer processing similar to that conducted in FIG. 4A next occurs. Namely, a horizontal span for 
processing is initially selected, 238 "Select A (Next) Horizontal Span For Processing," and a pixel Xs 
position therein is identified. 240 "Select A (Next) Pixel Xs Position In Selected Span." The depth value of 

so the selected Xs pixel is interpolated and compared to the stored value in the corresponding location of the 
second Z-buffer, 242 "Compute Z Value of Selected Pixel and Compare to Corresponding Contents of 
Second Z-Buffer." Inquiry is then made into whether the selected pixel is visible to the subject Jight source, 
244 "Is Selected Pixel Visible To Light Source (i)?" If "yes," then the corresponding location in the second 
Z-buffer is updated with the just calculated pixel depth value Zs, 246 "Update Second Z-Buffer With Pixel 

55 Zs Value." Once updated, or if the subject pixel is not visible to the light source (e.g., its in shadow), 
processing passes through junction 248 to inquiry 250 "AH Pixels In Span Selected?" Processing then 
continues to loop back to instruction 240 to select a next pixel Xs position in the selected span until all 
pixels in the span have been processed. Thereafter, inquiry is made whether all spans have been selected. 
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Geometry Processing." Processing includes fetching a pnmitive from «J^™ ns 
and control points to world coordinates (if necessary 

necessary) and dipping to a view volume (, n = ■^^SS^t 258 -Calculate Vertex 
world coordinates, i.e., if no, f'^ equations only, using the primitive. 

Colors." The colors are calculated from the specular ^ a ^se a a ^ * attributes. Next, 

surface and color attributes, the vertex normals. Triangle Vertices to 

"Calculate Partial Derivatives dZs/dXs and dZs/dYs. adjusted toward 

Preferably, a processing step is ^f* This is needed 

the subject light source (i) by a bias value equal to JJJJ™^ djfferent vjew coordinates and the 
since the co^ ^^ in certain cases; i.e.. a range of pixels 

effective resolution of X and Y for the polygon eoy z-buffer. The problem is 

in X.Y space will not map to the same address in ttO's . s ^ e < jnt view , while Z - 

iHustrated in FIG. 5. As shown therein. Z-buffer r^^^^Hot considered, there wil. be 
buffer 2 contains Z values from a light source vie^ f t JJJ^^JJi by a neighboring pixe.(s). In 
certain pixels which will be erroneously processed as shadow asrf smea y « ^ ^ 

FIG. 5. for example, pixel E has a Zs value of 8, but maps to Z-buffer 2 with a a b ^ ^ 

the Zs values are interpolated against Xs.Ys instead of X.Y). This pixel wou.u 
shadow without some compensation. above-referenced Williams article. The 

The problem is not unique to the present invention. J*^J* ^ a t°s t o prevent the effect when each 
solution presented therein was to add a bias within the po.ygon 

point is transformed to the light source view. Smc the ^ n ^^ t ^ yi ^ 
rather than transforming each point, the bias is added to the Zs values ol for e P ^ 
Furthermore, greater accuracy is obtained by catauIat.ngthob«M as^ unc^ 
gradient of the polygon with respect to the Hght •«£^££< ^ ^ edge processing 

result then the constant bias proposed in the Williams article u\ n paroc ^ ^ 
function is calculating the derivatives for span ^ ra ^^°^^^Z effect of moving the 
dZs/dYs, and adjusts the vertex Zs value by the »° proper registration of the 

triangle closer to the light source by its surface gradient m Xs and Ys and causes p p 

Xs.Ys plane. F|G 4C1 scan conv ersion of edges into a 

Continuing with the ^J^^^^ E d gls £ Series of Horizonta. Spans." This 
series of horizontal spans next occurs, 268 Scan oonven g converting ^ triangle edges to 

involves computation of the Bresenham parameters or DOA ^slopes .to scan con g ^ g 

produce X.Y.Z.R.G,B.Xs,Ys & Zs, and then scan converting of the triangle eages .mo 
series of horizontal (or alternatively vertical) spans. nrocessing, 270 "Select A (Next) 

A pixel X position is identified by first selecting a ho ^ nX ^ n J^^ 272 -select A (Next) 
Horizontal Span For Processing," and then selecting a pixel posraon w.u k • 

and compared to 

Pixel X Position In Selected Span." The Z value of the selectee I P ^ » ? To 

the contents of the viewpoint depth buffer, f ISTJ the selected pixel are 

Corresponding Contents of First Z-Buffer." Next, the Xs Ys Z L^ents of the second Z-buffer at 
computedA.nterpo.ated and the calculated Zs value » compa ed to _the co, tents o z 
location Xs.Ys, 276 "Compute Xs.Ys.Zs Values of Seected Pixel ^Jjgf J£ ^ C ° sib|e from both the 
Buffer At Location Xs.Ys." Inquiry ^^'^.^J^ and Light Source 

:^;rrn^^ 

ssr. r/s s; r ~ i s-» p on Ce ,, . . 
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span have been processed, then inquiry is made into whether ail spans have been processed, 286 "All 
Spans Selected?" If "no," processing loops back to instruction 270 where a next horizontal span is 
selected. Once all pixels and spans have been processed, inquiry is made whether all light sources have 
been selected, 288 "All Light Sources 0) Selected?" If "no," then processing returns to FIG. 4B at 
5 instruction 230, i.e., select a next defined light source (i) to accomplish PASSES 2i, & 2i + 1 . Once all light 
sources have been selected the frame buffer contains the sum of color intensities due to any ambient light 
and each of the defined tight sources (i), including any shadows defined thereby, and processing is 
terminated, 290 "End." 

It will observed form the above discussion that a unique shadow generation approach has been 
10 provided capable of efficiently handling multiple light sources. Significantly reduced processing times in 
comparison with prior shadow rendering techniques are attained, thereby improving user interactiveness 
with the graphics system. Shadow processing pursuant to the invention attains a performance comparable 
to non- shadowed, shaded polygons with hidden surfaces removed. The approach is implemented primarily 
in hardware and maintains a mapping between a viewpoint and a light source by interpolating the respective 
is Z-buffer addresses into dual Z-buffers during span generation. Novel characteristics include the use of 9- 
axis interpolation instead of the traditional 6-axis, accommodation of multiple light sources through a simple 
technique of multiple passes over the scene, and correction of depth buffer registration errors by 2 
displacement in the direction of a light source view gradient in Xs,Ys space (light source view coordinates). 

20 Claims 

1. A method for rendering a scene formed pf at least one geometric primitive as a pixel image with a 
shadow using a computer graphics display system including a first Z-buffer, a second Z-buffer and a 
frame buffer, each of said buffers having storage locations corresponding to the pixels forming said 

26 image, said image having a defined viewpoint and light source, each primitive being represented by 
one or more pixels (X,Y) relative to said defined viewpoint and one or more pixels (Xs.Ys) relative to 
said defined light source, said method comprising the steps of: 

(a) for each of said pixels (X,Y) representative of said at least one geometric primitive: 

(i) generating a first depth value (Z) representative of the depth from said defined viewpoint to 
30 said pixel, and 

(ii) saving said first depth value (Z) in the corresponding pixel location of said first Z-buffer if the 
first depth value (Z) defines a location equal or closer to said viewpoint than a depth value stored 
in said corresponding pixel location of said first Z-buffer; 

(b) for each of said pixels (Xs.Ys) representative of said at least one geometric primitive: 

35 (i) generating a second depth value (Zs) representative of the depth from said defined light 

source to said pixel, and 

(ii) saving said second depth value (Zs) in the corresponding pixel location of said second Z- 
buffer if the second depth value defines a location (Zs) equal or closer to said light source than a 
depth value stored in said corresponding pixel location of said second Z-buffer; and 
ao (c) for each of said pixels (X.Y) forming said image: 

(i) generating, using only said defined light source, a representative color value (Rs.Gs.Bs) for 
said pixel (X,Y), and 

(ii) adding to a corresponding (X,Y) location of said frame buffer said representative color value 
(Rs,Gs,Bs) if the corresponding depth value of said first Z-buffer identifies a pixel visible to said 

45 viewpoint and the corresponding depth value of said second Z-buffer identifies a pixel visible to 

said light source. 

2. The method of claim 1, wherein said image to be rendered has a defined ambient lighting value and 
wherein said step (a) includes: 

so (iii) generating, using only said ambient lighting value, a representative color value (R.G.B) for said 

pixel (X,Y) and storing said representative color value (R,G,B) in the corresponding (X,Y) pixel 
location of said frame buffer. 

3. The method of claim 2, wherein said at least one geometric primitive is defined by a data structure of 
55 one or more polygons and wherein said generating step (a) (iii) includes scan converting said polygons 

into a series of pixel spans and placing for each span said representative color value (R,G,B) from the 
end values of said span for each pixel in said span. 
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4 The method of claim 1, wherein a plurality N of light sources are defined and each primitive is 
rcpZld by one or more pixels (Xs,Ys) (S = 1.2...N) relative to each of said N defined hg t sources 
Z wherein said method further comprises the steps of repeating said steps (b) and (c) ,n combination 
S each of s^d N defined light sources, said second Z-buffer being cleared prior to each combined 
repetition of said steps (b) and (c). 

5 The method of claim 1. wherein each of said at least one geometric primitive is defined in a data 
ZcZX one or more po.ygons and wherein said generating step (a)(i) includes scan coning 
said polygons into a series of pixel spans and interpolating for each span from the end values of sad 
span said first depth value (Z) for each pixel in said span. 

6 The method of claim 1. wherein each of said at least one geometric primitive is defined in a data 
structure by one or more polygons and wherein said generating step (b)(i) mc udes scan convert, g 
said polygons into a series of pixel spans and interpolating for each span from the end values of said 
span said second depth value (Zs) for each pixel in said span. 

7 The method of claim 1, wherein said at least one geometric primitive is defined by a data structure of 
' one or more polygons and said generating step (c)(i) includes scan converting ^^""V 

series of pixel spans and interpolating for each span said representative color value (Rs.Gs.Bs) from the 
end values of said span for each pixel in said span. 

8 The method of claim 1. wherein said at least one geometric primitive is defined by a data structure of 
one or more polygons, said polygons being defined by their vertices, and wherein said generating step 
b )(i) includes adfusting the second depth value (Zs) at each of said polygon «*«m^ ^ 
light source to substantially eliminate any misregistration between said one or more pixels (X.Y) relative 
to said defined viewpoint and said one or more pixels (Xs.Ys) relative to said defined light source. 

9. The method of claim 1 , wherein the order of said steps (a) and (b) is interchanged. 

10. A method for rendering a scene formed of at least one geometric primitive as a pixel image with a 
shadow, said at least one geometric primitive being defined by a data structure said method using a 
computer graphics display system having a geometry processing engine and a raster processing 
engine and further including a first Z-buffer. a second Z-buffer and a frame buffer, each of sad buffers 
being coupled to said raster processing engine and each having storage locates correspondmg _to the 
pixefs forming said image, said image having a defined ambient lighting value, viewpoint and ligh 
source such Lt each primitive has one or more pixels (X.Y) associated therewith .n 

coordinate space, and each primitive has one or more pixels (Xs.Ys) assorted therew.tr. .n a second, 
light source coordinate space, said method comprising the steps of: 

(a) processing said data structure through said geometry processing engme and sa.d raster 
processing engine of said computer graphics display system so as for each of sad one or more 

P ' X o! S g ( iIratea fiTd^pth value (Z) representative of the distance from said defined viewpoint to 

(^saT'said first depth value (Z) in the corresponding pixel location of said first Z-buffer if the 
first depth value (Z) is equal or closer to said viewpoint than a depth value stored in sa.d 
corresponding (X,Y) pixel location of said first Z-buffer, and - A „• ol 

(iii) determine, using only said ambient lighting, a representative color value (R.G.B) for said pixe 
and store said determined representative color value (R.G.B) at the corresponding (X.Y) pixel 
location of said frame buffer; 

(b) processing said data structure through said geometry processing engine and sad raster 
processing engine of said computer graphics display system so as for each of said one or more 

pixels (Xs.Ys) said engines: ^ . , irih , 

(i) generate a second depth value (Zs) representative of the d.stance from said defined light 

source to said pixel, and _ « 

(ii) save said second depth value (Zs) in the corresponding pixel location of sa»d second Z-buffer 
if the second depth value (Zs) is equal or closer to said light source than a depth value stored .n 
said corresponding (Xs.Ys) pixel location of said Z-buffer; and 
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(c) processing said data structure through said geometry processing engine and said raster 
processing engine of said computer graphics display system so as for each pixel (X,Y) of said pixel 
image, said engines: 

(i) calculate, using only said defined light source, a representative color value (Rs.Gs.Bs) for said 
5 pixel, and 

(ii) add to the corresponding (X.Y) pixel location of said frame buffer said corresponding 
representative color value (Rs.Gs.Bs) if the corresponding depth value of said first Z-buffer 
identifies a visible pixel in said viewpoint coordinate space and the corresponding depth value of 
said second Z-buffer identifies a visible pixel in said light source coordinate space. 

w 

11. The method of claim 10, wherein said pixel image has multiple defined light sources associated 
therewith, each of said light sources defining a separate light source view coordinate space, and 
wherein said method further includes repeating said steps (b) and (c) in combination for each of said 
multiple light sources such that for each pixel said frame buffer contains the cumulative color intensities 

75 due to said ambient lighting and said multiple defined light sources. 

12. The method of claim 10, wherein each of said at least one geometric primitive is defined in said data 
structure by one or more polygons and wherein prior to said first data structure processing step (a) a 
viewpoint transformation matrix Mv is created, said generate step (a)(i) including for each primitive 

20 transforming the associated polygons to device coordinates using said created matrix Mv, scan 
converting the edges thereof into a series of pixel spans, and interpolating from the end values of said 
spans said first depth value (Z). 

13- The method of claim 10, wherein each of said at least one geometric primitive is defined in said data 
25 structure by one or more polygons and wherein prior to said second data structure processing step (b) 
a light source transformation matrix Mi is created, said generate step (b)(i) including for each primitive 
transforming the associated polygons to device coordinates using said matrix Mi, scan converting the 
edges thereof into a series of pixel spans, and interpolating from the end values of said spans said first 
depth values (Z). 

30 

14. The method of claim 10, wherein each of said at least one geometric primitive is defined in said data 
structure by one or more polygons and wherein said calculate step (c)(i) includes scan converting said 
polygons into a series of pixel spans and interpolating for each span said representative color value 
(Rs,Gs,Bs) from the end values of said span for each pixel in said span. 

35 

15- The method of claim 10, wherein said at least one geometric primitive is defined in said data structure 
by one or more polygons, said polygons being defined by their vertices, and wherein said generate 
step (b)(i) includes adjusting the second depth value (Zs) at each of said polygon vertices relative to 
said light source to substantially eliminate any misregistration between said one or more pixels (X ( Y) in 

40 said viewpoint coordinate space and said one or more pixels (Xs,Ys) in said light source coordinate 

space. 

16- A computer graphics display system with shadow generation capability for rendering a scene formed of 
at least one geometric primitive as a pixel image having a defined ambient lighting value, viewpoint and 

45 light source such that each primitive has one or more pixels (X,Y) associated therewith in a first. 

viewpoint coordinate space, and one or more pixels (Xs.Ys) associated therewith in a second, light 

source coordinate space, said computer graphics display system comprising: 

a geometry processing engine for converting said at least one geometric primitive into device X,Y,Z 

coordinates relative to said viewpoint and into device Xs,Ys,Zs coordinates relative to said light source; 
so a frame buffer having storage locations corresponding to the pixels forming said image for 

receiving representative pixel color values; 

a first Z-buffer having storage locations corresponding to the pixels forming said image for storing 

first depth values (Z) representative of the depth of selected pixels (X.Y) in said image relative to said 

viewpoint; 

55 a second Z-buffer having storage locations corresponding to the pixels forming said image for 

storing second depth values (Zs) representative of the depth of selected pixels (Xs.Ys) in said image 
relative to said light source; 

a raster processing engine coupled to receive the device coordinates output from said geometry 
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processing engine and coupled to each of said frame buffer, first Z-buffer and second Z-buffer. said 
raster processing engine including: . 

(i, means for generating for each pixel (X.Y) associated with said at least one geometric pnm,t,ve a 
: pM depth value (Z) and for storing said value (Z) in a corresponding (X.Y) location of sa.d first Z- 
5 buffer when said pixel depth value (Z) is equal or closer to said viewpoint than a depth value stored 

in said corresponding location of said first Z-buffer; 

(ii) means for generating for each pixel (Xs,Ys) associated with said at least one P»£"» 
a second pixel depth value (Zs) and for storing said value (Zs) in a correspondmg (Xs.Ys) locatton of 
said second Z-buffer when said second depth value (Zs) is equal or closer to sa.d light source than 

io a deoth value stored in said corresponding location of said second Z-buffer; 

(iii) means for generating a representative color value (Rs.Gs.Bs) for each pixel forming said image 
using only said defined light source; 

(iv) means for adding to a corresponding (X.Y) pixel location of sa,d frame buffer each o said 
generated representative color values (Rs.Gs.Bs) for said pixels if the corresponding depth value in 

,s said first Z-buffer identifies a pixel visible to said viewpoint and the corresponding depth value ,n 

said second Z-buffer identifies a pixel visible to said light source. 

17. The computer graphics display system of claim 16. wherein said raster processing engine further 

20 means for generating a representative color value (R.G.B) for each pixel forming said image using 

onlv said ambient lighting value; and 

means for adding to a corresponding (X.Y) pixel location of said frame buffer each o sa,d 
generated representative color values (R.G.B) for said pixels at the corresponding (X,Y) p.xel location of 
said frame buffer. 

25 18. The computer graphics display system of claim 16, wherein said raster processing engine generating 

means (i) includes; . „ . 

means for scan converting said at least one geometric primitive into a series of pixel spans, and 
means for interpolating said first depth value (Z) for each pixel in said span from the end values of 
so said span. 

/, 19. The computer graphics display system of claim 16. wherein said raster processing engine generating 

me ^ S eans'for U si S n converting said at least one geometric primitive into a series of pixel spans; and 
35 means for interpolating said second depth value (Zs) for each pixel in said span from the end 

values of said span. 

20. The computer graphics display system of claim 16, wherein said raster processing engine generating 

means (iii) includes: . _ rte> . onH 

w means for scan converting said at least one geometric primitive mto a series of pixel spans, and 

means for interpolating said representative color value (Rs.Gs.Bs) for each p.xel ,n sa.d span from 
the end values of said span. 
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© A computer graphics display system and meth- 
od are described for rendering a scene formed of at 
least one geometric primitive as a pixel image hav- 
ing shadows produced by at least one defined light 
source. Multiple passes are made through the primi- 
tive data structure for each light source capable of 
producing shadows in the scene to be rendered. In a 
first pass, the scene is rendered to a frame buffer in 
the usual way. but using only the ambient compo- 
nent of the light specification, and a first Z-buffer is 
updated with the viewpoint Z value. For each defined 
light source (i), two additional passes (PASS 2i and 
2i + 1) through the data structure are required. In the 
first of these, a transformation matrix is set up in 
such a way that the viewpoint is moved to the 
position of the light source. The scene is then ren- 
dered in the usual way except that the frame buffer 
is not updated, and a second Z-buffer (light source 
view Z-buffer) is used instead of the first Z-buffer. In 
the next pass, the shaded image and shadows are 
generated in parallel using the content of the first 
and second Z-buffers. When the frame buffer is 
updated, it is accomplished in a cumulative manner 
with each computed intensity value due to a specific 
light source being added to any value already stored 
there. In this way. intensities resultant from each of 



multiple light sources are accumulated on the image, 
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